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15 December 1983 


MEMORANDUM FOR: 

Contracting Officer 

a 

THROUGH : 

Chief, Systems Engineering Branch, ODP 


Chief, Engineering Division, ODP j* 


Executive Officer, ODP 

FROM: 

Keith E. Silliman 


IBM 

SUBJECT: 

Presentation of Computer System Performance Data 


1. I request permission to present computer system 
performance data obtained from Agency IBM computer systems to a 
group of computer system performance analysts and programmers. 

2. VHien approved, I intend to present that data at an IBM 
internal VM Data Management Seminar to be held in Boca Raton, 
Florida, January 24 - 26, 1984. The paper and presentation foils 
will be published in an 'IBM Internal Use Only' proceedings 
document . 

3. None of the material to be presented is classified or 
controversial. I will discuss the technical aspects of VM 
computer system performance. The title of the paper is "VM 
Performance Analysis and Capacity Planning With Emphasis on 
DASD". a copy of the paper is attached along with a copy of the 
foils to be used for the presentation. 


L 

I If any reference is made as to the source of the data, 

it will be identified only as from a customer account. 

Keith E. Silliman 



STAT 

STAT 


cc: Michael L. Johnson, w/o attachments 
P. Fred Stepler, w/o attachments 
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VM PERFORMANCE ANALYSIS AND CAPACITY PLANNING 
WITH EMPHASIS ON DASD 

by 

Keith E. Silliman 

IBM Corporation 
Federal Systems Division 
18100 Frederick Pike 
Gaithersburg, Maryland 20879 
Tie 372-7132 
301 840-7132 

This paper presents some results and conclusions from performance 
analysis and capacity planning work done with a large scale (3081 D) , 
high performance (sub-second trivial response time) VM/CMS intensive 
computer system. We will discuss the performance analysis and capacity 
planning methodology, summarize some results, make observations on 
subsystem capacity values, and indicate future directions. 

Methodology 

Our approach to performance analysis and capacity planning was to 
characterize the capacity of the system, by subsystem component (CPU, 
Main Storage, and DASD), in terms of number of 'users*. (The 
characterization was accomplished by plotting the subsystem utilization 
as a function of the number of active users.) This methodology 
provided a sufficiently precise measure of the system environment, at a 
relatively low cost in system and manpower resources, for both gross 
level performance analysis and capacity planning functions. It 
indicates the percent of subsystem utilization per user, which is 
instrumental in system tuning when the objective is to balance 
subsystem capacities. Assuming that the workload mix does not 
significantly change, subsystem utilization can be linearly projected 
for capacity planning purposes, based on anticipated future user loads. 

This methodology was a synthesis of the system decomposition approach 
of Major (IBM SYST J 20 #1 1981) and Wicks (GG22-9299, 1982) in an MVS 
environment and the user orientation of Tetzlaff (IBM SYST J 18 //I 
1979) in a VM environment. 

Results 


In this environment, we see 2.0 to 2.5 logged users per active user. 
(Definitions of the measures discussed can be obtained from the VMAP 
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documentation.) This relatively low ratio of logged to active users 
occurs because users are not allowed to leave a logged on terminal 
unattended. The logged to active ratio is generally indicative of user 
response, with the lowest ratio (approximately 2 logged to 1 active) 
giving the best response. A fully utilized (190 to 200 percent) 3081 D 
processor supports between 120 and 160 active users, indicating an 
active user can absorb between 1.7 and 1.2 percent of the processor's 
capacity. The percent processor utilization values can be normalized 
to ARIPs for purposes of comparison across processors (See 'LARGE 
SYSTEM ARIPs "Approximate Relationships in Performance'", ZZ05-0386). 

Main storage utilization in VM is not a very meaningful measurement. 
Therefore, we have focused our attention on user working set size and 
system paging rates. Normally, user working sets are in the 100-120 k 
byte (25-30 pages) range and are associated with moderate to low paging 
rates. Paging is a function of main storage access demand. As the 
number of concurrent users increases, the amount of storage available 
to each decreases until page faulting occurs with essentially every 
access. Page thrashing conditions associated with working set sizes of 
70 k bytes have been observed. 

The pagable portion of main storage, or the Dynamic Paging Area, 
constitutes approximately 12 of the 16 megabytes of the system's main 
storage configuration. The other 4 megabytes include the nucleus, 
internal trace table, and free storage area, with free storage 
requiring more than 3 megabytes. 

I/O interrupt rates of up to 1250 per second have been observed. That 
translates into DASD I/O activity rates of 5-7 per active user per 
second, or 2-3 I/Os per second for user and system (non-paging) I/O and 
the remaining 3-4 per second for paging activity to drums. The 
translation of DASD I/O rates into percent capacity of the device is 
generally not straightforward. The capacity of a DASD to do I/O is a 
function of the device characteristics, the pathway configuration, data 
block size, and access methodology. In this environment, however, the 
performance characteristics of the three types of DASD (IBM 3380 disk, 
IBM 2305 drum, and STC 4305 solid state drum) are the primary 
variables. The I/O pathway configuration is relatively stable, the 
data block size is fixed by function and is generally 2 k bytes for 
user data and 4 k bytes for paging, and the access methods are 
constant . 

Plots of device utilization as a function of I/O activity and I/O 
activity queued as a function of device utilization indicate device 
capacities to do I/O. Comparison of values for different I/O and 
processor configurations indicate the effect of those components on I/O 
device capacity. 

Those plots confirm the 30-35 percent device busy rule of thumb for 
3380s and indicate an 'average' capacity of 12-15 I/Os per second, 
device service times of 20-25 milliseconds, and I/O activity queued of 
less than or equal to 10 percent. ('Average' values are indicated for 
a 9 -hour day with peak period values of 2 to 2.5 times the 'average'.) 
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For 2305 drums, used as paging devices with three exposures, 10 percent 
I/O queued occurs around 45 percent device busy, indicating an 
’average' capacity of 25-35 I/Os per second depending on the system 
configuration. Device service times of 10-20 milliseconds are 
observed. The highest I/O capacity values are available from devices 
on dedicated pathways on 3033 processors, with lower values for devices 
on 3081 processors or contended pathways. 

For the solid state drums, used as paging devices with three exposures, 
projections of logical device busy to 45-50 percent indicates an 
'average' I/O capacity of greater than 60 per second. Device service 
times on data streaming channels at approximately 30 I/Os per second 
are between 3 and 5 milliseconds. 

Capacity Observations 

A gross level performance analysis of the VM system indicated an 
imbalance between CPU and main storage capacity. Between 120 and 160 
active users can be supported by a 190-200 percent utilized processor, 
but only 120 active users with working set sizes of 100 k bytes can be 
supported in the 12 megabytes of dynamically pagable storage. The 
support of 160 active users (40 beyond the 'capacity' of main storage) 
is accomplished through the high performance characteristics of the 
paging subsystem. However, at the high paging rates associated with 
160 active users, the processor resources are increasingly consumed by 
CP paging overhead, thereby resulting in decreasing amounts of virtual 
(problem program) time to accomplish user work. 

The non-paging DASD configuration to support 120 active users is 
estimated to be between 24 and 30 arras (3 I/Os per active user per 
second * 120 active users / 15 or 12 I/Os per second per device) . For 
our environment with average user minidisks in the 3-5 cylinder range 
and the low ratio of active to total users, the 3380 's I/O and storage 
capacity are reasonably balanced for user minidisk storage. However, 
the storage capacity of the 3380 is excessive relative to its I/O 
capacity for higher density of data reference system functions such as 
temporary and S and Y disk accesses. Multiple, partially allocated 
disks are dedicated to those functions to obtain the desired 
performance. Forty-four 3380 arms are configured on the 3081 system to 
support the I/O load and accommodate the I/O access skew across 
devices . 

The paging DASD configuration to support 120 active user at 4 pages per 
user per second would be 20 devices at 25 pages per second, 12 devices 
at 40 pages per second, and 8 devices at 60 pages per second. Our 
experience shows that IBM 2305 drums have the I/O capacity of 25 to 35 
I/Os per second and that solid state drums are projected to have an I/O 
capacity of 60 I/Os per second. 

The I/O pathway configuration to support the nonpaging I/O load is 
estimated to be approximately 6 pathways (channel /control unit) - 360 
I/Os * .004 sec per I/O / 25 percent pathway component busy, or 6 to 8 
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arms per path. Ten channel pathways (5 symmetrical pairs) are 
configured to support the current I/O load requirement as well as to 
provide for future growth. 

For the paging I/O load, approximately 1 pathway per logical device is 
indicated for rotating drums and 1 pathway per 2 logical devices for 
solid state drums. However, both the 2305 and the 4305 are configured 
with multiple logical devices per controller, 2 on the 2305 and either 
2 or 4 on the 4305. The current configuration includes 12 logical solid 
state drums accessed via 6 channel pathways. Previous 2305 drum 
configurations had 8 logical drums accessed via 8 channels. 

The capacity of the channel/ control unit path to do I/O is empirically 
determined by comparison of device service times with pathway component 
utilization. Initially, maximum tolerable device service time values 
are specified. Then, by adding workload or devices, I/O pathway 
loading is increased until the maximum specified device service times 
are reached. Device service time increases concomitantly with pathway 
component utilization because of increasingly frequent missed device 
reconnects. The resultant pathway loading values (I/O rates) are 
considered to be capacity values. Preliminary results indicate that 
'average' pathway capacity is approximately 50 I/Os per second for 
rotating devices and 100 I/Os per second for solid state devices, the 
difference being the penalty of a full rotation for missed reconnects. 

Future Work 

The near term future requires the development of an I/O configuration 
that will support the growing CMS intensive workload on a 3081 K with 
32 megabytes of main storage and continue to provide the same or a 
higher performance environment. 

The longer term project is the characterization of the VM user's 
terminal utilization. The intent is to determine the time a user is 
logged on the system, length of session, number of interactions per 
session, and user 'think' time. We anticipate that this information 
will provide insight into the question of the number of users a 
terminal can support and, correspondingly, into system resource 
requirements per system user or per terminal. This information will 
also assist in the exploration of the relationship of system 
performance and user productivity in this VM/CMS environment. 

A still longer term, lower priority, task is the characterization of 
the functions of a computer performance analyst. This information may 
be instrumental in the establishment of an effective process of 
identification and development of performance analysts to satisfy the 
growing demand. 
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PERCENT PRIMARY DRUM SPACE 
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DRUM STORAGE CAPACITY 
IN LOGGED VM USERS 



LOGGED VM USERS 


Legend 

SW4D8M 
X S2 9D16M 
□ S111D16M 
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CHANNEL UTIUZATION AND 
3370 DASD PERFORMANCE 



Legend 
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CHANNEL ACTIVITY RATE 
AND 3370 DASD PERFORMANCE 


70 -I 

□ 



I/Os PER SECOND ON CHANNEL 


Legend 

A DEVI 
X DEV 2 
□ DEV3 
H DEV4 
S CHAN1 
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HIGH PERFORMANCE CMS INTENSIVE WORKLOAD 
PERFORMANCE CHARACTERISTICS AND CONFIGURATION REQUIREMENTS 


ARIP 

ACTIVE LOGGED 

MEGS 

PAGES 

I/Os 

DRUMS 

DASD 

CHAN 

I 

20 

50 

3 

40 

80 

1 

4 

2+T&T 

2 

40 

100 

5 

80 

160 

2 

7 

3+T&T 

3 

60 

150 

8 

120 

240 

3 

10 

5+T&T 

4 

80 

200 

10 

160 

320 

4 

14 

6+T&T 

5 

100 

250 

12 

200 

400 

5 

17 

8+T&T 

6 

120 

300 

15 

240 

480 

6 

20 

9+T&T 

7 

140 

350 

17 

280 

560 

7 

24 

lO+T&T 

8 

160 

400 

20 

320 

640 

8 

27 

12+T&T 

9 

180 

450 

22 

360 

720 

9 

30 

13+T6cT 

10 

200 

500 

24 

400 

800 

10 

34 

15+T&T 

11 

220 

550 

27 

440 

880 

11 

37 

16+T&T 

12 

240 

600 

29 

480 

960 

12 

40 

17+T5cT 

13 

260 

650 

32 

520 

1040 

13 

44 

19+T&T 

14 

280 

700 

34 

560 

1120 

14 

47 

20+T&T 

15 

300 

750 

36 

600 

1200 

15 

50 

22+T5cT 

ACTIVE 

= ARIP/ 

.05 [50000 

inst/act 

user/sec] 



LOGGED 

= ACTIVE 2.5 







MEGS 

= (0.4 

* ARIP) 

+ (ACTIVE * 

WKSET 

[100]) 



PAGES 

= ACTIVE * WKSET/4 

1.6 / 

THINKTIME [20 

sec ] 


I/O 

= ARIP/ 

.0125 

[12500 inst / 

I/O] 




DRUMS 

= PAGES/40 







DASD 

I/O * 

0.5 / 

12 






CHAN 

= DRUMS/ 1 + DASD/8 

+ TAPE/? 

+ TERMINAL/? 
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METHODOLOGY 

IDENTIFY FORFORMANCE CONSTRAINTS 
BALANCE SYSTEM RESOURCES 
PLAN FUTURE RESOURCES 
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RJTURE 

CONRCURE & ANALYSE 3081 K - 32 MEGS 
CHARACTERIZE SYSTEM RESOURCE REQUIREMENTS PER TERMNAL 
PERFORMANCE ANALYST - EDUCATION, TRAINING, CAREER PATH, ... 
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